On Stochastic Approximation
نویسنده
چکیده
This paper deals with a stochastic process for the approximation of the root of a regression equation. This process was first suggested. by Robbins and Monro [1]. The main result here is a necessary and sufficient condition on the iteration coefficients for convergence of the process (convergence with probability one and convergence in the quadratic mean).
منابع مشابه
APPROXIMATION OF STOCHASTIC PARABOLIC DIFFERENTIAL EQUATIONS WITH TWO DIFFERENT FINITE DIFFERENCE SCHEMES
We focus on the use of two stable and accurate explicit finite difference schemes in order to approximate the solution of stochastic partial differential equations of It¨o type, in particular, parabolic equations. The main properties of these deterministic difference methods, i.e., convergence, consistency, and stability, are separately developed for the stochastic cases.
متن کاملAPPROXIMATION SOLUTION OF TWO-DIMENSIONAL LINEAR STOCHASTIC FREDHOLM INTEGRAL EQUATION BY APPLYING THE HAAR WAVELET
In this paper, we introduce an efficient method based on Haar wavelet to approximate a solutionfor the two-dimensional linear stochastic Fredholm integral equation. We also give an example to demonstrate the accuracy of the method.
متن کاملCombination of Approximation and Simulation Approaches for Distribution Functions in Stochastic Networks
This paper deals with the fundamental problem of estimating the distribution function (df) of the duration of the longest path in the stochastic activity network such as PERT network. First a technique is introduced to reduce variance in Conditional Monte Carlo Sampling (CMCS). Second, based on this technique a new procedure is developed for CMCS. Third, a combined approach of simulation and ap...
متن کاملA stochastic network design of bulky waste recycling – a hybrid harmony search approach based on sample approximation
Facing supply uncertainty of bulky wastes, the capacitated multi-product stochastic network design model for bulky waste recycling is proposed in this paper. The objective of this model is to minimize the first-stage total fixed costs and the expected value of the second-stage variable costs. The possibility of operation costs and transportation costs for bulky waste recycling is considered ...
متن کاملApproximation of stochastic advection diffusion equations with finite difference scheme
In this paper, a high-order and conditionally stable stochastic difference scheme is proposed for the numerical solution of $rm Ithat{o}$ stochastic advection diffusion equation with one dimensional white noise process. We applied a finite difference approximation of fourth-order for discretizing space spatial derivative of this equation. The main properties of deterministic difference schemes,...
متن کاملApproximation solution of two-dimensional linear stochastic Volterra-Fredholm integral equation via two-dimensional Block-pulse functions
In this paper, a numerical efficient method based on two-dimensional block-pulse functions (BPFs) is proposed to approximate a solution of the two-dimensional linear stochastic Volterra-Fredholm integral equation. Finally the accuracy of this method will be shown by an example.
متن کامل